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Introduction 

The automorphism group of certain one-relator groups was studied by several authors. 
D. Collins in [3] obtained the presentation by generators and defining relations of the 
automorphism group of Baumslag - Solitar groups G{1, m) = (a, b; a~^Ua = b^) when 
|/| = lor|m| = lor|Z| > 1, \m\ > 1 and I and m are coprime; in particular, in these cases 
the group AutG(/,m) turns out to be finitely related. Later D. Collins and F. Levin 
[4] found the presentation of the group Aut G'(/,m) when m — Is, \l\ > 1 and |s| > 1 
and showed thereby that in this case the group Aut G{1, m) is not finitely generated. In 
the same paper the more extensive class of groups G = (ai, a2, . . . , a^, t; t~^wH = w'^) 
where w is a word in ai, a2, ... , was considered. When n ^ 2, w is neither a 
proper power nor primitive in the free group (ai, a2, • • • , a^) and m = Is with \s\ > 1, 
authors gave the presentation of group Aut G and this group turns out to be infin- 
itely generated too. Some HNN-extension of Baumslag - Solitar groups G{1, m; k) = 
{a,t; a~^ta}t~^ a'^t = d^) were considered by A.M.Brunner in [2]. In the case when 
|/| 7^ \m\ he described all endomorphisms of such groups and noted that if |/| = 1 or 
\m\ = 1 then the group K\xtG{m,n;k) is not finitely generated. Using the Brunner's 
results, M. Kavutskii and D. Moldavanskii [5] under assumption \l\ ^ \m\ obtained the 
presentation of Aut G(m, n; k) and proved that this group is finitely generated if and 
only if none of the integers I and m is divisor of another. Furthermore, if the group 
Aut G{m, n; k) is finitely generated then it is finitely related. It should be mentioned 
here that up to now it is unknown whether the automorphism group of any one-relator 
group is finitely presented if it is finitely generated. 

Results listing above are relative to one-relator groups which in either case are con- 
nected with Baumslag - Solitar groups. In the present paper we consider another class 
of one-relator groups consisting of groups Gmn with presentation 

Gmn^{a,b; [a^,b^] = l) 
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where m and n are arbitrary integers satisfying inequalities m > 1 and n > 1. We 
obtain the presentation of group Aut Gj^n by generators and defining relations and 
thereby prove that it is finitely related. We prove also that any normal automorphism 
of every group Gmn is inner. 

As can be immediately verified the following mappings of generators of group Gmn 
define the automorphisms of Gmn (which will be denoted by the same symbols): 

A : a I— > a~^, 6 i— > 6; 

ji : a\-^ a, 6 i— > h~^; 

u : a ^ a~^, h i— > . 

It is evident that A^ = //^ = 1, A// = //A and X/j, = u and therefore these automorphisms 
together with the identity mapping constitute the subgroup K of group Aut Grnn and 
K is the Klein four-group. If m = n the mapping 

rj : b, 6 i— > a 

defines one more automorphism of Gmn- 

The relations rf = 1^7] ^Xrj = n and r] ^ ^irj = 
A (which can also be immediately checked) show that the subgroup L of AutG^^ 
generated by subgroup K and element rj is the split extension of K by the 2-cycle (77). 
It will be shown here that if m 7^ n then Aut Gm.n = K ■ Inn Gmn and if m = n then 
AutG^^ = L ■ InnG^^. More explicitly, we shall prove the following 

Theorem 1. Let X, jji and rj be the automorphisms of group Gmn defined above and a 
and j3 be the inner automorphisms of Gmn generated by elements a and b respectively. 

If m ^ n then group Aut Gmn is generated by the automorphisms X, ji, a and j3 and 
defined by the relations 

1. X^=fi^ = l; ^ 

2. Xf^ = f.X; "^ = "' 

3. X-'aX = a-'; ^. /i"^/?/. = /?" ^ 

4. X-^PX = P; 

If m = n then group Aut Gmn is generated by the automorphisms X, fj,, r], a and P 
and defined by the relations 1-7 and the additional relations 

8. rf = 1; 
9- r]~'^Xr] = 11; 



_^ ^ 10. r] ^ar] = p. 



Theorem 1 can be applied to characterize the normal automorphisms of groups Gmn- 
Let us recall that an automorphism of a group G is said to be normal if it maps onto itself 
every normal subgroup of G. It is evident that any inner automorphism is normal. In 
general, the converse is not true. It was proved in [6, 7] that any normal automorphism 
of a non-cyclic free group must be inner. Generalizing this result M. Neschadim [10] 
exhibited that the same assertion is true for any group which is a non-trivial free product. 
Also he gave the example of one-relator group possessing a normal automorphism which 
is not inner. Nevertheless, for groups Gmn we have : 
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Theorem 2. Any normal automorphism of group Gmn is inner. 

We note that the residual finiteness of group Gmn (i- 6., recaU, for any non- identity 
element g e Gmn there exists a homomorphism ip of group Gmn onto some finite group 
X such that gip 7^ 1) is well known; it follows, for example, from the result of paper [1]. 
Since Gmn is finitely generated, then by Mal'cev theorem [9], it is Hopfian; i.e. every 
of its surjective endomorphism is an automorphism. Some other properties of these 
groups were considered in [12] where, in particular, their construction as amalgamated 
free product and the description of their endomorphisms were given. These results can 
be used for somewhat shortening of the proof of our theorem 1 but for completeness we 
shall give here the independent proof. 

1. Preliminaries 

As we have just mentioned, the group Gmn can be constructed as amalgamated free 
product and we begin from some properties of this group-theoretic construction. 

Let G — [A* B] H) he a, free product of groups A and B with amalgamated subgroup 
H. Then any element g E G can be written in the form g = X1X2 ■ ■ ■ Xg, where elements 
xi, X2, ■ ■ ■ , Xs belong in turns to one of groups A and B and if s > 1 then no one of 
them belongs to subgroup H. Such representation is called a reduced form of element 
g and the number s of factors of it (uniquely determined by g) is called a length of g 
and denoted by l{g). An element g is said to be cyclically reduced if either l{g) — 1 
or the factors xi and Xs of its reduced form g ~ X1X2 • • - Xg do not belong to the same 
subgroup A OT B (the definition is correct since all reduced forms of element g have or 
do not have this property simultaneously). It is easy to see that any element of G is 
conjugate with a cyclically reduced element. Moreover, an immediate induction gives 
the 

Proposition 1.1. // element g of group G — {A * B; H) is not cyclically reduced and 
l{g) > 1 then g can be written in the form 

g = u ■ V ■ , 

where elements u and v have reduced forms u = x\X2 ■ ■ - Xr and v = j/ij/2 with 

r ^ 1 and s ^ 1, element v is cyclically reduced, elements Xr and yi do not belong to 
the same subgroup A or B and if s > 1 then element ysX~^ does not belong to subgroup 
H. 

By means of proposition 1.1 it is easy to prove the 

Proposition 1.2. Let element g of group G = (A * B; H) do not belong to subgroup 
A and let g^ E A for some integer k ^ 0. Then g = x~^yx for some x,y & G where 
element y belongs to one of subgroups A or B and y'^ & H. 



Also we need the simple 
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Proposition 1.3. Let G = {A* B; H) and suppose that the amalgamated subgroup H 
is contained in the centre of both groups A and B. If element g & G does not belong to 
subgroup A then g~^Ag (1 A = H . 

Indeed, the inclusion H C g~^Ag H A is evident. To prove the inverse inclusion let 
p be the natural homomorphism of group G onto quotient group G/H which is the 
ordinary free product of quotients A/H and B/H. Then since gp ^ Ap we have 

{g-'Ag n A)p C {gp)-\Ap){gp) D (Ap) = 1 

and therefore g~^Ag O A C. H. 

Further, we need the construction of group Gmn in terms of amalgamated free prod- 
uct. For this purpose let H = (c, d; [c, d] = 1) be the free abelian group of rank 2, 
A = {{a) * H] = c) be the amalgamated free product of infinite cycle (a) and H 
and B = {H * (b); d = 6") be the amalgamated free product of H and infinite cycle (6). 
Then it easy to show by means of Tietze transformations that group Gmn is isomorphic 
to the free product {A * B; H) of groups A and B with amalgamated subgroup H. 
These notations are assumed in what follows. 

Since in constructions of groups A and B the amalgamated subgroups are central in 
the free factors, proposition 1.3 gives the 

Proposition 1.4. // an element g of group A does not belong to subgroup H then 
g~^Hg n H = (c) , and if an element g of group B does not belong to subgroup H then 
g-^HgnH={d). 

Proposition 1.5. Any element g of group Gmn such that g~^Hg H H ^ 1 is contained 
in subgroup A or in subgroup B. 

For the proof it is enough to show that \i g = xiX2 ■ ■ - Xg is reduced form of g 
with s > 1 then g~^Hg H H = 1. Let us suppose that xi e A\ the case x\ & B 
is considered similarly. For any element h E H the inclusion g~^hg e H implies the 
inclusions x^^hxi G H and X2^{xi^hxi)x2 G H. Thus, x^^hxi e x^^Hxi fl H and 
since Xi G A \ H it follows from proposition 1.4 that x^^hxi = c^ for some integer k. 
Similarly, inclusion X2^c^X2 € X2^Hx2 H H gives X2^c'^X2 — d^ for some integer Z, and 
since element d^ lies in the centre of group B, we have the equality = dK As elements 
c and d form the basis of free abelian group H, hence k = 1 = {) and h=l. 

Proposition 1.6. Any abelian subgroup of group Gmn which contains a cyclically re- 
duced element of length greater than 1 is cyclic. 

Proof. Let U be abelian subgroup of group Gmn and let U contain a cyclically reduced 
element u of length greater than 1. It is not difficult to see that any element of Gmn 
commuting with u is either element of H or cyclically reduced of length greater then 1. 
Since proposition 1.5 implies U r\H = 1 we conclude that all nonidentity elements of U 
are cyclically reduced of length greater than 1. 

Let u be the nonidentity element of U of the smallest length and u = uiUi • • • tt^. be 
a reduced form of it. We claim that subgroup U is generated by u. Namely, for any 
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nonidentity element v & U we shall prove by induction on l{v) that v is equal to some 
power of u. 

Let V = V1V2 ■ ■ -Vs be a reduced form of element v. Replacing, if necessary, element 
V by element v~^, we can assume that elements ui and vi belong to the same subgroup 
A or B. Then since elements Vg and tti do not belong to the same subgroup A or B 
and the right side of equation 

■ ■ ■ U2^U^^ViV2 ■ ■ ■ VsUiU2 ■ ■ ■ Ur = f if 2 • • • f s 

is cyclically reduced the product h = ■ ■ ■U2^u^^viV2 ■ ■ - v^ must be element of H. 
So, if s = r we have h = u~^v e U and since t/ fl = 1 we obtain the equality v = u 
giving the basis of induction. 

If s > r then v = uv\ where v' = hvr+i ■ ■ - Vs- Since l{v') < s then by induction 
v' = for some integer k. Hence v — u^^^ and proof is complete. 

2. Proof of Theorem 1 

Proposition 2.1. For any automorphism </? of group Gmn there exists an inner auto- 
morphism •0 of Gmn such that either a^ipil^) e A and h^Lpil^) & B or aiLpif:) G B and 
b{ifi^) e A. 

Proof. Let (p be an automorphism of group Gmn and u — aip, v — hip. At first, we note 
that elements u and v cannot be cyclically reduced of length greater than 1. 

If, on the contrary, element u is cyclically reduced and l{u) > 1 then element u'^ is 
also cyclically reduced of length greater than 1, and since ['u"^,t'"] = 1, by proposition 
1.6 elements and generate the (infinite) cyclic subgroup. Therefore, — v'^^ 
for some nonzero integers r and s. But this equation implies the equation a"*^ = h'^^ 
which is not satisfied in group Gmn- 

On the other hand, element u is conjugate with a cyclically reduced element and 
after multiplying p by suitable inner automorphism we can assume that u is cyclically 
reduced. Consequently, by the remark above u E A ox u E B. 

Suppose firstly that u E A. We claim that iiv ^ B then v — xyx~^ where x E A and 
y E B and therefore x~^ux e A and x~^vx e B. So, multiplying (p by one more inner 
automorphism we obtain the desired result. 

Since u and v generate the group Gmm v ^ A. Hence li v ^ B then l{v) > 1 and 
since v is not cyclically reduced it has by proposition 1.1 the form 

V = XiX2 ■■■Xr- ym ■■■ys- ixiX2 ■ ■ ■ Xr)~^ 

where r ^ 1, s ^ 1, element X1X2 ■ ■ ■ Xr is reduced, element yiy2---ys is cyclically 
reduced, elements Xr and yi do not belong to the same subgroup ^4 or S and if s > 1 
then element ysX~^ does not belong to subgroup H. 

We assert now that the assumption xi E B leads to the contradiction. To prove this, 
let us note firstly that if xi E B then l{v'^) > 1 and the first syllable of reduced form 
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of v'^ is xi. This is evident if s > 1 or if s = 1 and ^ H. If s = 1 then yi e B 

since if i/i G A then elements u and v are contained in the normal closure in Gmn of 
subgroup A and therefore cannot generate the group Gmn- Hence Xr E A and r > 1. If 
yi^H then G y^^Hyi fl if and by proposition 1.4 = for some integer k 0. 
Therefore XryiX^^ E A\H, l{v'^) = 2r — 1 > 1 and the first syllable of reduced form of 
v'^ is xi. 

Now, since xi E B the equality v~'^u"^v"' = implies inclusions G H and 
x^^u^xi G H. Since u E A\H (because the quotient group of Gmn by the normal 
closure of H is not cyclic) and xi E B \ H the proposition 1.4 implies that u"^ = 1, a 
contradiction. 

So, xi E A. If V does not have the form claimed above then r > 1 and elements 
Ui = Xi^uxi and Vi = x^^vxi turn out to be in the previous case. 

Thus, we have proved that if element u = aip belongs to subgroup A then after 
multiplying, if necessary, automorphism by one more inner automorphism we have 
u E A and v E B. Similar arguments will show that if element u = aip belongs to 
subgroup B then after multiplying, if necessary, automorphism (f by one more inner 
automorphism we get u E B and v E A. 

Proposition 2.2. Let elements u and v of group Gmn be such that u G A\H , v E B\H 

and [tt^, v^] = 1 for some integers r 7^ and s 0. Then u = x~^a^x and v = y~^b^y 
where x E A, y E B and nonzero integers k and I are such that kr is divided by m and 
Is is divided by n. 

Proof. We note, firstly, that E H and E H. Indeed, if, say, ^ H then since 
E A., E B and [u^ , f*] = 1 we get E H. Hence = u~'^v^u^ E Hnu~'^Hu'^ and 
= v~^v^v E Hr\v~^Hv. Proposition 1.4 implies now that = 1 which is impossible. 
Since u E A \ H and E H then proposition 1.2, applied to the group A = 
((a) * H; = c), gives u = x~^zx where x E A, element z is contained in subgroup 
(a) or in subgroup H and element z"^ belongs to subgroup {a"^). But if z E H then the 
inclusion z'^ E (c) is possible only if 2; G (c) . Thus, in any case z = a'' for some integer 
k ^ and m divides kr because z^ E {a^). 

So, we have proved that u has the required form. The assertion on the element v is 
proved similarly. 

Proposition 2.3. Let F be the subgroup of group Gmn generated by elements x~^a^x 
and y~^Uy where x E A, y E B and k,l E Z. Then F — Gmn if and only if \k\ — 1 — \l\ 
and X E (a) ■ (d) , y E (b) ■ (c). 

Proof. If \k\ — 1 = \l\ and x — a^d'^, y = b'^c'^ for some integers p, q, r, s then elements 
c = {x~^ax)'^ and d = {y~^by)'^ belong to subgroup F and since a = d^{x~^ax)d~'^ 
and b = c^{y~^by)c~^ we have a E F and b E F and therefore F = Gmn- 

Conversely, let us suppose that F = Gmn- Then the quotient group of Gmn by its 
commutator subgroup G'mn is generated by elements and 6' and since Gmn /Gmn i^ 
the free abelian group with basis a, 6 we must have \k\ — 1 — \l\. 

Let Ai denote the subgroup of Gmn generated by subgroup H and element x~^ax 
and let Bi denote the subgroup of Gmn generated by subgroup H and element y~^by. 
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Since H ^ Ai ^ A and H ^ Bi ^ B, it follows by the theorem of H. Neumann (see 
e. g. [11], p. 512) that the subgroup Fi generated by Ai and Bi is the free product 
of groups Ai and Bi with amalgamated subgroup H and An Fi = Ai, B Cl Fi = Bi. 
Therefore, since F ^ Fi the equality F — Gmn implies Ai = A and Bi — B. 

Now we shall prove that if = ^ then a; e (a) ■ (d). Let x = x\X2 ■ ■ - Xr be the 
reduced form of element x (in the decomposition of group A in amalgamated product 
A = ((a) *H; = c)). 

If a; ^ (a) ■ {d) then r ^ 2 and if r = 2 then xi E H and 0:2 G (a). If r > 2 and 
xi e (a) then letting x' — X2Xs • • • we see that subgroup Ai is generated by subgroup 
H and element {x')~^a{x'). Now if Xr & H then r > 3 and letting x" = X2X3 ■ ■ -Xr-i 
we see that subgroup Ai is generated by subgroup H and element {x")~^a{x"). Thus, 
we have shown that if x ^ (a) • {d) then we can assume without loss of generality that 
r ^ 2 and Xi E Xr E (a). 

Let A be the quotient of group A by central subgroup (a"^) and g denote the image 
of element g E A under the natural homomorphism of A to A. Then A is the ordinary 
free product of cyclic group (a) of order m and of infinite cycle (d). The image Ai of 
subgroup Ai is generated by element d and by image x~^ax of element x~^ax. Our 
assumptions about x imply that 

is the reduced form of element a;~^aa;. This in turn implies that any alternating product 
of nonidentity powers of elements x~^ax and d is reduced as written. Thus, Ai ^ A 
(since a ^ Ai) and hence Ai ^ A. Consequently, the equality Ai — A really implies 
the inclusion x E (a) ■ (d) and the same arguments will show that the equality Bi — B 
implies the inclusion y E (b) ■ (c). 

Now we can complete the proof of Theorem 1. Let (p be an automorphism of group 
Gmn- Proposition 2.1 implies that for some inner automorphism ijj of Gmn 

we shall get 

either a{(pip) e A and b{(p'ip) E B or a{(p'ip) G B and b{(p'ip) e A. 

Firstly, let us consider the case when a{<fil^) G A and b{<filj) G B. Since elements 
ai^pi/j) and bi^Lpip) generate the group Gmn and hence no one of them belong to subgroup 
if, it follows from proposition 2.2 that a{ipil^) — x~^a'^x and biipif:) — y~^Uy for some 
X E A, y E B and nonzero integers k and I. Now, proposition 2.3 implies that a{(p^l)) = 
d~Pa^dP and b{(fi'ip) = c~%^c'^ for some integers p and q and £, 5 = ±1. Then the product 
of Lpip by the inner automorphism generated by element c~^d~'^ belongs to subgroup K 
and therefore E K ■ InnGmn- 

Now, let a{(p'i/j) E B and b{ipil:) E A. Then by proposition 2.2 a((/P'0) = y~^b^y and 
b{(fij;) ~ x~^a^x for some x E A, y E B and nonzero integers k and I where kn is divided 
by m and Zm is divided by n. Since proposition 2.3 again gives \k\ — 1 = \l\, conditions 
of divisibility imply the equality m = n. Thus, if m 7^ n then Aut Gmn = K ■ InnG^„. 

If m = n then the group Gmn has the automorphism i] and since Ai] = B and 
Bt] — a we obtain a^Lpil^r]) E A and b{(p'i/jr]) E B. Therefore, automorphism ipil^rj 
belongs to subgroup K ■ Inn Gmn- This means that (p E L ■ Inn Gmn- Thus, in the case 
m = n we obtain Aut Gmn = L ■ InnG^^. 
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The validity of relations 1 - 10 in the statement of theorem 1 can be checked immedi- 
ately (and this in part was singled out above) and it remains to show that these relations 
do define the group AutG^-n- Making use of relations 3 - 6 in the case m ^ n and of 
relations 3-6 and 10 in the case m — n, any relation in the pointed out generators of 
Aut Gmn can be transformed to the form uv = 1 where tt is a product of elements A 
and (or A, /i and ry) and v is a, product of elements a and Since the unit is the only 
element of subgroups K and L inducing the identity automorphism of quotient group 
Gmn/G'^^, we can conclude that 

K n Inn Gmn = 1 and L fl Inn Gmn = 1 

and therefore the relation uv = 1 implies u = 1 and v = 1. Since relations 1 and 2 define 
the group K and relations 1, 2, 8 and 9 define the group L, the relation w = 1 is derivable 
from the relations singled out in Theorem. Since the presentation above of group Gmn as 
amalgamated free product with regard to corollary 4.5 in [8] makes evident the triviality 
of its centre, the group Inn Gmn is isomorphic to Gmn and therefore the relation v = 1 
must be derivable from the relation 7. Thus, any relation in the indicated generators of 
group Aut Gmn is derivable from the relations 1-10 and the proof is complete. 

3. Proof of Theorem 2 

We begin with the rather obvious remark. If (/p is a normal automorphism of a group 
G and if A?" is a normal subgroup of group G then the mapping ip of the factor group 
G/N onto itself, defined by 

{gN)lp^{g^)N {g e G), 

is an automorphism of group G/N and this automorphism is normal too. The auto- 
morphism If is said to be induced by automorphism (p. 

Now, let (/? be a normal automorphism of group Gmn- Then by Theorem 1 </? = ^t/j 
where i/j G InnGmn and ^eK if m^n or ^eL if m = n. Since automorphism 
(fi is normal if and only if the automorphism ^ is normal, it remains to show that any 
non-identity element of subgroups K and L is not normal automorphism. 

Let M and N denote the normal closure in group Gmn of elements o™ and b'^ re- 
spectively. Then the quotient group Gmn/M is the free product of cycle (a) of order 
m and infinite cycle (b) and the quotient group Gmn/^ is the free product of infinite 
cycle (a) and cycle (6) of order n. 

Since the orders of elements aM and bM of the group Gmn/M are different, then 
any automorphism of form kt] where k & K does not induce any automorphism of this 
quotient and therefore is not normal by the remark above. 

In the same quotient group Gmn/M the elements bM and {bM)~^ are not conjugate, 
since two elements of a free factor of an ordinary free product are conjugate if and only 
if they are conjugate in the factor. Therefore, automorphisms JI and V of group Gmn/M, 
induced by the automorphisms fi and v respectively, are not inner and consequently, by 
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the mentioned above result in [10], JI and 17 are not normal. Hence, from the remark 
above it follows that automorphisms and u of group Gmn are not normal. Analo- 
gously, automorphism A induces a non-inner automorphism in the quotient Gmn/^ and 
therefore is not normal. Theorem 2 is demonstrated. 
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